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Abstract 

We study top quark Kaluza-Klein (KK) mode mixing in the Randall-Sundrum scenario with all 
the SM fermions and gauge bosons in the bulk. Even though the simple assumption of universal 
bulk fermion mass leads to the same KK mass spectrum for all the SM fermions and thus 
suppresses new contributions to the flavor changing neutral current and the p parameter, large 
Yukawa coupling of the top quark generates the mixing among its KK modes and breaks the 
degeneracy: Unacceptably large contribution to Ap occurs. In order to satisfy the Ap constraint, 
we relax the model by assigning a different bulk fermion mass to SU(2) singlet bottom quark, and 
demonstrate that there exists some limited parameter space where the Ap constraint is satisfied. 
It is also shown that the current measurement of Br(I? — > X s + 7) can be accommodated in this 
modified model, and one sigma level precision constrains the effective weak scale h^w such as 
kEW <; 3 TeV for m^/k = —0.4, where Icew is the warp-suppressed AdS§ curvature. 
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I. INTRODUCTION 



Inspired by recent advances in string theories, some particle physicists have resort to extra 
dimensions for the gauge hierarchy problem of the standard model (SM). Arkani-Hamed, 
Dimopoulos and Dvali (ADD) proposed that there exist n large extra dimensions with 
factorizable geometry |1J : The observed huge Planck scale Mpi is attributed to the largeness 
of the extra dimension volume V n , since Mp { = Mg +2 V n with Ms being the fundamental 
string scale. The hierarchy problem is resolved as Ms can be maintained around TeV. 
Later Randall and Sundrum (RS) proposed another higher dimensional scenario where the 
hierarchy problem is explained by a geometrical exponential factor, based on two branes 
and a single extra dimension with non-factorizable geometry ||. Apart from the gauge 
hierarchy problem, TeV scale extra dimensions accessible to the SM fields have drawn a lot 
of interest due to various motivations such as gauge coupling unification || , new mechanisms 
for supersymmetry breaking [[|, the explanation of fermion mass hierarchies ||, and the 
presence of the Higgs doublet as a composite of top quarks ||. 

Of great significance and interest is that extra dimensional models can leave distinct 
and rich phenomenological signatures at future colliders. In the ADD scenario, due to the 
large volume of extra dimensions, the SM fields should be confined to our brane. Only the 
graviton propagates in the bulk, to be observed as Kaluza-Klein (KK) gravitons with almost 
continuous mass spectrum |7]]. In the models of TeV scale extra dimensions accessible to 
the SM fields, KK excitations of the SM gauge (and possibly fermion) fields with TeV scale 
masses would be observed as resonances || [|. In the original RS scenario, the SM fields are 
assumed to be confined to our brane. Phenomenological signatures come from KK gravitons 
with electroweak scale masses and couplings to matter, characterized by A,,-. However, the 



small size of the RS-bulk allows that the SM fields may also be in the bulk. In Ref . [1(J , it is 
demonstrated that placing the SM gauge fields in the RS-bulk while confining the fermions 
to our brane is strongly constrained by the current precision electroweak data so that the 
lowest KK state of gauge boson should be heavier than about 23 TeV. Then is pushed up 
to about 100 TeV, which is disfavored as a solution of the gauge hierarchy problem. If both 



the SM gauge and fermion fields are in the bulk their phenomenological signatures are 
very sensitive to the bulk fermion mass which determines the KK mass spectrum of the 
bulk fermions and their interactions with bulk gauge bosons. 
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In the early study of the RS-bulk SM, Yukawa interactions with the Higgs field have 
been ignored due to small quark masses compared to the KK mass scale. Then a simple 
assumption of universal bulk fermion mass suppresses their contributions to flavor changing 
neutral current (FCNC) as well as the p parameter [[□], |T^[. This is because the common 
leads to the same KK mass spectra for all the SM fermions. The degeneracy of the up-type 
(and down-type) quark KK modes operates the GIM cancellation [I3| KK-level by level: 
With the minimal flavor violation assumption that at the tree level the flavor mixing comes 
only through the CKM matrix, FCNC is suppressed as in the SM. Since the KK modes 
of two constituents of SU(2)-doublet have also the same mass, their contribution to the p 
parameter vanishes. However, the Yukawa interaction with the Higgs field mixes the fermion 
KK tower members, which can be substantial for the top quark |TT[ [14]]. Recently it has 
been shown that the large mixing in the top quark KK sector leads to unacceptably large 



contribution to the p parameter and raises above 100 TeV fl5|| . To accommodate those 
electroweak precision data, a 'mixed' scenario is proposed with the third generation fermions 
on the TeV brane but the other generations in the bulk. However, the first excited KK mode 
of gauge bosons should be heavier than 11 TeV due to the strong constraints from precision 
measurements: It is hard to probe the new physics effects at LHC. In addition, the obvious 
discrimination of fermions according to generation may lead to potentially dangerous FCNC 
due to the absence of GIM mechanism. 

It must be worthwhile to keep the original framework where all the SM particles except 
for the Higgs boson are in the bulk, and to question other unsubstantiated assumptions. 
Then most of the rich phenomenologies of the RS-bulk SM at future colliders can remain 
still valid. We propose to relax the universal bulk fermion mass assumption. As the simplest 
and minimal extension, and particularly to satisfy the p constraint, we assign a different bulk 
fermion mass mL to the SU(2)-singlet bottom quark field, and see whether there exists some 
parameter space to accommodate the p and B — > X s 7 constraints. We shall show that this 
mL allows some limited parameter space where the degeneracy between the top and bottom 
quark KK modes is retained, suppressing their contribution to the p parameter. Through a 
careful and thorough analysis, the current constraint from the b —>■ sj decay shall be also 
shown consistent with the model. 

This paper is organized as follows. In Sec. DJ we briefly review the RS-bulk SM, focused 
on the KK reduction and interactions of bulk gauge bosons and bulk fermions. In particular, 
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we point out a subtle point when placing the SM fermions in the RS-bulk: The fermion field 
contents should be doubled. In Sec. |TT|, we first discuss why the minimal model should be 
extended, by estimating its large contribution to the p parameter. With a different bulk 
fermion mass for the SU(2)-singlet bottom quark field, we present the full mass matrixes 
of the top and bottom quark KK modes, including the Yukawa interactions with the Higgs 
field confined to our brane. Through explicit diagonalization of the top quark KK mass 
matrix, we present generic features of the KK mode mixing. In Sec. [TV], we review the p 
parameter and show there exists some parameter space where the Ap constraint is satisfied. 
Section [V] deals with the detailed study of the effects of the KK modes of W gauge bosons 



and up-type quarks on the decay rate of & — ^ 37. Finally, Sec. [Vj includes summary and 
conclusions. 



II. BULK SM IN THE RS SCENARIO 



In the RS scenario, a single extra dimension has been introduced with non-factorizable ge- 
ometry, which is compactified on a Si/Z 2 orbifold of radius r c JJ. Requiring four- dimensional 
Poincare invariance, the RS configuration has the following solution of the five- dimensional 
Einstein's equation: 

d s 2 = G MN dx M dx N = e-^ri^dx^dx" + r 2 d<j) 2 , (1) 

where the four-dimensional metric tensor is defined by r]^ u = diag(l, — 1, — 1, — 1), cr(0) = 
kr c \4>\, < |0| < 7r, and the five- dimensional curvature is R§ = —20 k 2 . Upper-case Roman 
indices run over all the five dimensions while the Greek indices over our four dimensions. 
Two orbifold fixed points accommodate two three-branes, the Planck brane at = and 
our TeV brane at |0| = ir. Due to the assignment of our brane at |0| = 7r, any mass at the 
Planck scale appears gravitationally red-shifted by the so-called warp factor of e = e~ fcrc7r . 
If kr c « 12, the hierarchy problem can be resolved. Four- dimensional Planck scale Mpi is 
related with the fundamental string scale M5 by Mpj = M^(l — e~ 2kTc7T )/k. Now let us review 
the masses of the KK modes of the bulk gauge and fermion fields, which are relevant to the 
p parameter and b —>■ 57 decay. The back-reaction of the bulk fields on the AdS^ metric is 
to be neglected. 
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A. Gauge field KK spectrum 



For a massless SU(2) gauge field A\ I {x,(j)), gauge invariant five- dimensional action is 



ra 16 



S A = ~\J d 5 xV^G G MK G NL F a KL F a MNl (2) 

where F£ IN = dMA a N — dNA a M — g^e ahc A b M A c N (a, 6, c = 1, 2, 3). By choosing the odd Z 2 -parity 
for A%(x, <p) |10[ and/or an appropriate gauge [fH]], A%(x, <fi) decouples from the Lagrangian. 
With the KK expansion of 



(3) 



n=0 



we have a four- dimensional effective action of massive KK gauge bosons as 



5_ 



/oo 
d A xY, 

n=0 



which is obtained by 



N 



(n) 



j 1 (4 n) (0)) + < j v 1 (^(0)) 



00 v ( S n )i 



(4) 



(5) 



Here, z$ (4>) and the normalization N^' are given by 



(n) 



4%) 



M 



(n) 



(6) 



N 



00 



3 fcr c 7r 



Ji(x^ 



where x^ = z^C 71 ") = M^'/kEw with fcgw = ek. Note that the wave function 
satisfies the orthonormal condition 



rOO 



#xi m) (0)x? ) (0) = 5 r ' 



which leads to Xa ^ = 1/ \/27r . The continuity of /c?0 at = and 
the coefficient to be 

a(n) = UM^/k) 



(n) 



and to be the roots of the following equation: 

J (a4 n) ) + a^Y (x^) = 0. 



(7) 

±7r determines 
(8) 

(9) 



Numerically we have x^ ~ 2.45, x% } ~ 5.57, x^ ~ 8.70, and x^ ~ 11.84 



.(2) 



(3) 



-.(1) 
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B. Review of Grossman-Neubert fermion KK spectrum 



Let us review in detail the KK solution of a bulk fermion with arbitrary Dirac bulk mass 



in the RS scenario [12, 18, 19], which causes a subtle problem when discussing the bulk SM. 
The five- dimensional action of a Dirac fermion \1/ with the bulk mass is 



S = J^xJdcP V^G hi [i ^(D A - - sign(0) M 



(10) 



where Da is the covariant derivative, 7— = (7^75), and the inverse vielbein 
diag(e CT , e a , e a , e a , l/r c ). The underlined upper-case Roman indices describe objects in the 
tangent frame. The contribution of the spin connection ujrca, which vanishes by including 
hermitian conjugates, is omitted. 

Integration by parts leads to the action 



S= U A x 





1 












-An 




—e r/Lj/j 



•r 



'*l (e-^ + e- 4CT ) * R - V R (er^di + <9 e" 4CT ) (11) 
-e- 4<T rrty sign(0) (f L tf fl + tfji* ^ 



where we impose periodic boundary conditions of ^l,r{x, 7r) = ^^(x, — 7r). With the KK 
expansion of \I/ 



(™) ^ e f(n) 



n=0 



(12) 



and the requirement of 



; *W/f>*(0/W(0) 



1 



d0e^/iT ) *(0)/^(0)=^ n , 



if- 3, -m) = -Mj"V/S(0), 



(13) 
(14) 



we have a tower of massive Dirac fermions with the effective action 

00 . 

S = ]T / d 4 x {^ (n) (x) ^ ^ (n) (x) - M { f n) ^ (n) (x) (x) } . 



n=0 



(15) 



Note that Z 2 -symmetric action constrains = + = (1 =F7s)^/2) to 

be Z 2 -odd, as can be seen from the first term in Eq. flTOl) . If is a Z 2 -even function 
then f R n ^ should be a Z 2 -odd function and vice versa. With v = m^/k of order one, 
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solutions are, for n^O, 



x {n \<p) = ^[Ji/2-,(^ (n) )+^ n) n / 2-,(^ ) ) 

iVv 



(16) 



r {n \<P) = ^[jy 2+ Az {n) )+^ n) Y 1/2+u (z^) 



and for n = 



X (O) (0) 



With the even Z 2 -parity of x an d the o 
conditions 



p va{4>) 



(17) 

>dd parity of T^ n \ Eq. fll4]) yields boundary 

(18) 



= 7-W 



0=O,7T 



which determine the coefficients B^fl and the normalization constants Ny 1 } , as well as the KK 
I" - - 1 = x^kfiw with = zj n ' ) (7r). We present only Z 2 -even part relevant 



fermion mass My = 
for later discussion: 



g {n) = J-(, + l/2)(M) B) /fc) 

y_ (i , +1/2) (Mj n) A) 



(19) 



1 



^+1/2) ^ fcr 

„fcr c 7r 



1 _ e l+2u 



1 + 2z/ 



X 



4 n)2 {^-,(4 n) )+/3i n) n_.(z? ) )}^ 



</>=o 



And x^ is the solution of 



J-(, + l/2)(4 n) ) +^V_ (1 , +1/2) (X^) = 



(20) 



which is the same as that of the right-handed one. We refer to Ref. |TT[ for the corresponding 
expressions of the Z 2 -odd part. 

Discussions on the physical and phenomenological implications of the parameter v are 
in order here. Note that the canonically re-scaled zero mode of Z 2 -even bulk fermion is 
proportional to e ( 1 /2+^)fcr- c |</,| ^ gee first line of Eq. ([II]) with Eqs. (0) and ([[7])). For 
v <C —1/2 the fermion bulk wave functions are localized toward the Planck brane: The 



magnitudes of its gauge couplings with KK gauge bosons are quite small. In Refs. [12, 20 



it has been numerically demonstrated that for v < —0.5 the couplings are too small to be 
probed at high energy colliders. For v ^> 1 the SM fermions become localized closer to the 



TeV brane: The model approaches the RS model with the gauge fields only in the bulk, 
which is phenomenologically disfavored due to unreasonably large [JTOJ . To be specific, 
if v > —0.3, the large contribution to the precision electroweak data pushes up to about 
6 TeV, beyond the direct production at any planned collider. In what follows, therefore, we 
consider the parameter space of v between —0.5 and —0.3. 



C. Accommodating the SM fermion sector 



In order to place the SM fermions in the AdSs bulk, the fermion field contents should be 
doubled. In the SM, a fermion field with left-handed chirality and that with right-handed 
chirality belong to different representations of a gauge group: For example, the left-handed 
up quark {ul) and the left-handed down quark (d^) form an SU(2)-doublet, while the right- 
handed up and down quarks {ur and cIr) are two SU(2)-singlet fields, ul and ur are related 
by the Dirac mass term, Yukawa coupling with the Higgs field. Two Dirac fermion fields, 
u and d, are enough to describe each generation in the quark sector. In the RS-bulk SM, 
a fermion which belongs to a specific representation of a gauge group should possess both 
left- and right-handed chiralities. If only one chiral state (e.g., ^l) exists, the second line in 
Eq. ( |ITD as well as the bulk mass term vanish: Non-trivial solution of the Tlr{4>) cannot be 
obtained. For each generation, we introduce four five-dimensional Dirac fields, an SU(2)- 
doublet fermion field Q = (q u , qd) T and two SU(2)-singlet fermion fields, u and d, with weak 
hypercharges Y = 1/6, 2/3, and —1/3 respectively. 

Since the SM fermion should correspond to the KK zero mode, we assign Z2-even wave 
function to the left-handed SU(2)-doublet and the right-handed SU(2)-singlet such that 

e 2a(<P) 



Q(x,cj)) 
u(x,<p) 



Ql + q r = Y1 

n 

Ul + Ur = Y^ 



and d(x, 4>) has the same KK decomposition as u(x 
mediated by the bulk W boson, connect q u and qj- 



QP(x)x {n) (<f>)+Q%\x)TW(4>)], (21) 

u^(xy n \^+u^(x)x in) (<P)\ , 

The charged current interactions, 



S 



ff'w± 



d 5 xv^Ge a ^= \q u W + <ld + h.c. 
a/2 



d x—j= 
v2 i =0 



00 



(22) 
(23) 



n,m=0 



n,m=l I J-tt 



h.c. 



where g = g 5 /^2nr c , and the KK expansion in Eqs. ([3]) and (^) have been substituted. 
^nlrT denotes the coupling of the m-th and the n-th fermion states to the Z-th W boson in 
the unit of the SM coupling. It is defined by 

c£T = V&F f ^^ x (n) (0)x (m) (0)x?(0). (24) 



III. PHENOMENOLOGICALLY VIABLE MINIMALLY EXTENDED MODEL 
A. Relaxing the universal bulk fermion mass assumption 

Now every SM fermion possesses its KK tower. We remind the reader that in the RS 
background the fermion KK mass spectrum is determined by the bulk fermion mass m^. A 
simple assumption of universal bulk fermion mass results in the same KK mass spectrum 
for all the SM fermions. The exact degeneracy between the KK masses for the T3 = ±1/2 
fermions cancels their contribution to the p parameter. In addition, the degeneracy among 
the KK masses of up-type quarks (and down type quarks) allows the GIM cancellation to 
occur KK-level by level. 

However, there is another mass source, Yukawa interaction. This Yukawa mass relates 
SU(2)-doublet with singlet (e.g., myq^u^). It is to be compared to the KK mass which is 
the coupling of q U Lq U R and UlUr. This difference results in mixing among the fermion KK 
modes. Since quark masses are much smaller than the KK mass scale, this mixing effect has 
been neglected in the early study. One exception is the top quark. Its heavy mass yields 
substantial mixing among top quark KK modes. The mass shift of the top quark KK mode 
from the rest up-type quark KK modes invalidates the GIM cancellation; FCNC becomes 
inevitable. More severe problem happens if precision measurements are taken into account. 
In particular, the p parameter becomes dangerous since it does not follow the decoupling 
theorem in the sense that its quantum correction increases with the squared mass difference 
between the T = 1/2 and T = —1/2 fermions. As each top quark KK mass deviates from 
the corresponding bottom quark KK mass, their additive contribution yields disastrous and 
unacceptable value of Ap. The problem does not ameliorate but worsens as we add more 
and more KK states Ol. 



In Ref . [15] , a 'mixed' scenario has been proposed such that the third generation fermions 
are confined on the TeV brane while the other two generations propagate in the bulk. 
This construction itself is interesting with the additional attractive feature of its natural 
explanation for the observed m c /m t and rris/mj, hierarchies. However, constraints from 
current precision measurements are rather strong that the first excited KK mode of gauge 
bosons is about 11 TeV, not leading to any new physics signatures at LHC In addition, the 
obvious discrimination of fermions according to generation may lead to potentially dangerous 
FCNC due to the absence of GIM mechanism: Without a detailed analysis of FCNC effects, 



Ref. |L5| claimed that the estimated size of KK Z boson exchange effects on the K — K 
mixing is within the uncertainty of the SM results. 

Instead, here we keep the original set-up but relax the unsubstantiated assumption of the 
universal bulk fermion mass. For the simplest extension, we assume that the SU(2)-singlet 
bottom quark field has different bulk fermion mass m'^, and see whether this introduction 
of another parameter can accommodate the Ap constraint without a new hierarchy. Then 
the five dimensional action for the third generation quarks becomes 

S = Jd 4 xJd(j)V^G [E^(iQj a V A Q + ii^ a V A t + ibj a V A b) (25) 

-sign(0) (m^ \QQ + ttj + m'^ bb^j . 

The compactification of the extra dimension leads to the KK mass terms such that 

oo 

C=- y £k EW [4"V) + + W} + xf\v')bt ] bf] + h.c, (26) 

n=l 

where we introduced additional dimensionless parameter v' = m'^/k. As explicitly shown 
in Eq. (|26|), the KK masses of fermions depend on the bulk fermion masses, and m'^. 



B. Mass matrix of the KK modes for the top and bottom quarks 

In addition to the KK masses, an observer on the TeV brane has another source for the 
fermion mass, Yukawa coupling with the Higgs boson. The Higgs mechanism should operate 
here so that KK zero modes of the bulk gauge boson and fermion, which correspond to the 
SM particles, acquire masses. However, the simplest case with the Higgs boson in the bulk 
results in some unsatisfactory consequences. First, the lowest mass eigenvalue of the gauge 
boson, proportional to the bulk mass of the Higgs field, has no suppression by the warp 
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factor |19| |. The Higgs bulk mass should be much smaller than the Planck mass scale. The 
gauge hierarchy problem has recurred. Second, the bulk Higgs mechanism cannot retain the 
correct SM gauge couplings of the photon, W and Z bosons if the SM fermions are in the 
bulk; if the fermions are on the wall, the SM mass relationship of the W and Z bosons is 



broken [IT|. It is concluded that at least one Higgs field must be confined to the TeV brane. 
The five- dimensional action for Yukawa interaction with the confined Higgs field is 



S 



ffH = - J d 5 xV^G 



^Q(x,<p)-H(x)b(x,<j>) 



(27) 



+ M e ""Q( X; 0) a . H{x) b t{x, 0) + h.c. 
k 



5(0 



where Ag* is the five-dimensional Yukawa coupling. Spontaneous symmetry breaking shifts 
the Higgs field as H° — > v$ + H ° with a VEV of the order Planck scale. Then the four- 
dimensional effective Lagrangian becomes 



-eff 



V / (0) . 

\QtL + XiQk + ■ ■ 



V2 



V2 

Xf(l + 2i/)/2(l - e 1+ ^ 



(QbL+XiQbL + 



L 



l R + XV^R 



(28) 



where X tjb = A 5 '°(l + 2i/)/2(l - e 1+ ' 2u ), v = ev 5 , \ n = X (n) (^> ^)/x (0) (^)> and x' n are with 
v' . Note that the right-handed SU(2)-doublet and the left-handed SU(2)-singlet 
do not appear in the Yukawa term due to the Z2-odd boundary conditions in Eq. ([181) . 

For definite presentation, we introduce the number of the KK states, n^, which is in 
principle infinity. Equations (|26|) and ( p8|) imply the mass terms of the KK modes as 
follows: 



r 



(4 0) t 



AV 

R 



t 



(1) 



1(0)7(1) 
°R °R 



€1 ■■■)M b 



V : / 

where the (2noo + 1) x (2noo + 1) matrix M.t,b are defined by 



v : / 



(29) 



Aft A*' 



A^ 



if if 




Afl 



Af 96 



if if 




(30) 
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The (rioo + 1) x (noo + 1) matrix .My 6 is from Yukawa mass terms, and the (ra^ + 1) x n c 
matrix M.kk from KK masses. They are given by 



M* Y 



mt,o 



Xi 
Xi Xi 

X2 X2Xl 



X2 
XlX2 

xl 



\ 



V : 



M 



Y 



M qt 



KK 



k 



EW 



(1) 



x f 




x 



(2) 
/ 







(l 


Xi 


X2 ■ 


. \ 




x'iXi 


X'lX2 ■ 




X2 


X2X1 


X2X2 ■ 




V ; 






/ 


/ 











M 



b 

KK 



k 



EW 



xf(y') 



xf{v') 



V 



(31) 



M\ 



M% K . Note that 



v • • • J 

where m t (b),o = ^t(b)v/V2 of electroweak scale, and M. KK — j v <-kk 
the bottom-right blocks of Ai t ,b vanish since there are no Yukawa couplings of Z 2 -odd bulk 
fermions. 



C. Diagonalization of up- type quark KK mass matrix 

Let us discuss the diagonalization of the Ai UiC ,t m detail. This shows generic features of 
KK mode mixing in the RS scenario, as well as being relevant for the b — > 37 decay. Since 
even in the modified model all the up-type quark fields have the same bulk fermion mass, 
M. u (c) is the same as M. t with the replacement of m tt0 by m u ( c ) )0 , collectively denoted by 
M. q . A real and symmetric matrix M. q is diagonalized by an orthogonal matrix M: 



diag(?? , 77!, • • -)MM q M T = diag(m g , M u M 2 , • • •), 



(32) 



where rjj = ±1 is introduced for the positive-definite mass. and u ( £' form (2noo + 1) 
left-handed mass eigenstates u' L ® 



,(«) 



£1 



(33) 
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FIG. 1: = X fx as a function of f with kr c = 11.5. The solid line is for odd modes 

(n = 1,3,5, ...) and the dotted line for even modes (n = 2,4,6, ...). 

For example, is a mixture of KK mass eigenstates u'® 

?ffi = E^.»)^®. (n=0,...,no). (34) 

j=0 

In what follows, the underlined index runs from zero to 21%^. In terms of mass eigenstates, 
the four-dimensional effective Lagrangian of the charged current, relevant for the FCNC, is 

£ = jf* ( E CSf%»)) bf-ftgw® + h.c. (35) 

Now let us discuss the diagonalization of M. q . For light quarks {m q $ = 0), M. q can be 
analytically diagonalized. Mass eigenvalues are 

mf = 0, Mj°) = M n ( 2 +n = 4 n) W, (36) 

which are obtained by the orthonormal matrix J\f^ : 

kt(P) _i kt(o) _ *r(o) _ n at(o) __/w"(0) /o ? x 

For top quark with non-negligible m f , the diagonalization of M. q is not trivial. Since 
m t fl is approximately the top quark mass of 175 GeV while the KK fermion masses are of 
the order TeV, the diagonalization can be made perturbatively unless xV s are m uch larger 
than unity. In Fig. [I], we present the values of Xn which are very sensitive to v: The solid line 
is for X2n-i an d the dashed line is for X2n {n— 1, 2, ■ • •). Note that x does not depend on 
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ksw- For v < —0.4, \x n \ rapidly increases so that the elements of My can be compatible or 
even larger than some elements of M.kk'- Diagonalization is to be made only numerically. 

For v > —0.3, m t fi/kEw is a good perturbation parameter, denoted by 5. To leading 
order in 5, the mass eigenvalues are 

m q = m , M n = k EW [x { f + y 5 )> M noo+n = k EW [xf ] - |U) , (38) 

and the elements of the orthonormal matrix Af are parameterized by 



AT - & rn)=Af + N , (39) 



where 



-2 



A/^ 1 ), , ~ A/ (1) ~ *" 



^(n) 

^ (1) (n , m) ~ N' {1 \n 00 +n,m) ^ ( n) 2 ~ ^ 2 for (n ^ Vfl) 

y2(xj — x ) ' 1 



IV. CONSTRAINTS FROM THE p PARAMETER 

The p parameter is defined by the difference between the W and Z boson self-energy 
functions re-scaled by each mass: 

U w (q 2 = 0) U z (q 2 = 0) 



mly m 2 z 



(41) 



It has been known to play a special role among precision measurements since it is sensitive 
to heavy fermions beyond SM: Its quantum correction increases with the mass difference 
between two constituent fermions of SU(2)-doublet. A SU(2)-doublet (f u , fd) T yields addi- 
tional contribution to p: 

Ap = ^Am 2 , (42) 
' 8V2ti 2 ' V ; 

where N c is the number of colors and Am 2 is given by 

m 2 u -m 2 d m d 
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FIG. 2: The KK masses for (a) the top and (b) bottom quarks when v = v 1 and Jzew = 1 TeV. 
Here we have employed a full numerical diagonalization. 

We denote masses of f u and f d fermions as m u and m d , respectively. As can be seen from 
the Am 2 in two limiting cases, 

m 2 for m u > m d 

Am 2 - \ , (44) 

(m u - m d ) 2 for m u ~ m d 

the contribution of any degenerate SU(2)-doublet to Ap vanishes. With the Higgs mass 
below 1 TeV, the current electroweak precision data constrain Ap < 2 x 10~ 3 at 95% CL 
(with Ap = p — psm), which restricts new SU(2)-doublet fermion mass spectrum to satisfy 



^Am 2 < (115 GeV) 2 . (45) 

i 

First let us demonstrate that the RS-bulk SM with the universal bulk fermion mass 
assumption [y = v') cannot satisfy this Ap constraint. Now that every SM fermion has its 
KK tower, we have various vacuum polarization graphs mediated by the fermion KK modes 
for the W and Z self energies. Since involved couplings incorporate the zero-mode of gauge 
boson KK modes, the simple relation of C^mQ = 8 nm allows us to ignore the Am 2 between 
different KK levels, to leading order. For degenerate top and bottom quark KK modes, i.e., 
for |M t (n) - M { b n) \ < M, (n) , we have 



Am 2 ^J2( M t ~ M b) 2 ■ (46) 

n 

Figure ^| presents the KK masses for (a) the top and (b) bottom quarks. Here we set 
kr c = 11.5, kgw — 1 TeV and the zero mode top quark mass to be 175 GeV and the zero 
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FIG. 3: The KK mass difference between the top and bottom quarks when v = v' and kEW = 1 
TeV. 

mode bottom quark mass 4.5 GeV. As v increases, the mass of an odd mode (n = 1, 3, ■ ■ •) 
approaches that of the corresponding even mode (n — 2, 4, • • •). For the bottom quark case, 
two KK modes are almost degenerate in most of the relevant parameter space. This is 
because of the small m^o compared to Icew- These different mass spectra for the top and 
bottom quark KK modes lead to dangerous contributions to Ap. In Fig.|3], we show top and 
bottom KK mass differences up to the fifth KK excitation states as a function of parameter 
v. Even though the Am decreases with u, it is too large to satisfy Eq. ([4"5|). 

Now let us allow v ^ v' and see whether there exists a parameter space where the 
degeneracy between the top and bottom quark KK modes is retained. We need large mixing 
among the bottom quark KK modes so that the rapid increase of in Fig.|2| can be 
slowed down. As discussed before, large mixing occurs with large negative v' . In Fig.f|, we 
shows, with the fixed v' = —0.6, the top-bottom quark mass differences for the first five 
excited modes. We find that for example the v = —0.39 case with v' = —0.6 gives vanishing 
mass differences below 20 GeV for the first five KK excited states. A remarkable point is 
that the Am decreases for higher KK modes; the contribution of higher KK modes becomes 
less important. 

V. CONSTRAINTS FROM B -► X sl DECAY 

It is well known that any kind of new physics beyond the SM is significantly constrained 
by flavor changing neutral current (FCNC), which the SM predicts to be suppressed at one 
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FIG. 4: The KK mass difference between the top and bottom quarks when v 1 = —0.6 and kEW = 1 
TeV. 

loop level by light quark masses relative to M\y and by small CKM mixing between the third 
and first two generations. In particular, the rare decay of B — > X,7 has been extensively 
studied within and beyond the SM pifl . Moreover, this decay mode is sensitive to the top 
quark sector, appropriate to probe any new physics related with top quark. The inclusive 
decay B — > X s 7 is approximated by the partonic decay b — > s'j with the following equality: 

r(B->x sl ) . r(6^ S7 ) 



T(B -> X c ev e ) r(6 
With the NLO QCD corrections, i? qU ark is @ 

6a 



R, 



cev P 



quark 



R, 



where z 



quark 



m l,pole/ m b— <-> all d 



A? 



%,pole 



m 

F(z) 



\V cb \ 2 7T. 



1 -Sz 2 

1 



—F(z) (\D(m b )\ 2 + 



A 



1 3 



z 3 - z A - I2z 2 \nz, 
a s (m b )\ 



(47) 



(48) 



(49) 



K\Z) \ 6 Tl 

The CKM factor is denoted by \ = V* b Vi S {i = u,c,t). The bremsstrahlung corrections and 
the necessary virtual corrections, in order to cancel the infrared divergence, are included in 



the term A 24 . 



A. Effects of the RS-bulk SM 



In the RS-bulk SM the b — ► 57 decay receives new contribution from the KK modes of 
the bulk W gauge boson and up-type quarks. As discussed before, the new contribution 
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to FCNC occurs since the degeneracy in the KK modes of up-type quarks is broken due to 
the top quark Yukawa coupling. We also point out that the effects of the RS-bulk SM on 
FCNC have complicated and distinct features compared to those of other extra dimensional 
models. For instance, in the models with universal flat extra dimensions accessible to all 
the SM fields, the conservation of extra dimensional momentum leads to the so-called KK 
number conservation H], which says that no single KK excited mode can be produced. This 
reduces the computation of its contribution to FCNC || . In the RS-bulk SM, however, non- 
trivial geometry does not respect this KK number conservation with which, e.g., QfoL^ would 
vanish for n^fl. Furthermore, in universal flat extra dimensions the bulk wave functions 
of bulk fermions are the same as those of bulk gauge bosons. The orthonormal conditions 
for the bulk wave functions simplify three-point couplings so that CqI^ (flat) = 5 nm . In 
the RS model, the bulk fermions have different bulk wave functions, sensitively dependent 
on the bulk fermion mass m^. Non-trivial three-point couplings become involved. 

Note that all the external particles are SM particles, i.e., zero modes of the bulk fields. 
Since Xa ■> the bulk wave function of the photon zero mode, is constant, the orthonormal 



conditions in Eqs. (0) and ( |13D imply 

r WWA _ r (-iff A _ <r 

Thus the contribution via the n-th up-type quark and the m-th W boson is the same as the 
SM result except for the internal mass and the additional three-point coupling. 

With a given W"\ the contributions of all the KK modes of massless up and charm 
quarks to (X u + X C )D in Eq. (|48|) are 

X (i,l) /' 



+ *J (ECC) !fl (4.o) = -\ (SV2 (<*")*« 

i=0 \ m ) \M W / j=\ 



(51) 



where x 9 ^ ^ = (M® / ' My)^j . For the equality in Eq. (|5l|), we have employed the unitarity 
condition of the CKM matrix (A u + A c +A t = 0) and the exact expressions forjV(°> in Eq. (0). 
In summary, the contribution of all the KK modes of bulk gauge bosons and up-type quarks 
is taken into account by the following replacement: 

fioo 2rioo / ,™ \ 2 / "CO \ 2 

/ () ; \Myy J \,,r. A) 



D(x\ m ) =► D RS = 



EES £ ) (52) 



,.i=i \M W 
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In the limit where the elements of M.y are much smaller than those of M.kk {y > — 0.3), 
the substitution of Eqs. fl38|) and (fH]) into(|52D yields, to leading order in 6, 

D(x\ m ) =► (53) 
D RS ~ L>(x; 0)0) ) 

+ gg gf) 2 [ g csr g| + } 2 * (*& + « *<W) 
+ (| car (-if + ^f^) } 2 d „ - jg <io*/4 J) ) 

= D{x> m ) + O(f) , 
where we have used the approximation of 

4,0 - 4-0 ( X + %I*T) > *U*0 - ( X - ^iM^) • (54) 

We conclude that in the limit where the Yukawa masses are smaller than the KK masses, 
the effect of the RS-bulk SM on the Br(B — > X s '-f) vanishes to leading order. 



B. Numerical Results 

Since the new parameter mL, introduced to satisfy the Ap constraint, does not affect the 
b — > S7 decay, three parameters of m t) o, Icew and v determine the contributions to b — > 57 
completely. First let us check whether the contributions to b —>■ 57 converge as we add 
more and more KK modes of W boson and up-type quarks. It is useful to introduce the 
cut-off on the number of the KK states, denoted by nc, and check the sensitivity of D in 
Eq. fl5"2|) to nc- D{m b ) is obtained by matching Wilson coefficients at electroweak scale and 
the subsequent RGE running. For the SM contribution the matching is performed at the 
next-to-leading order (NLO) while for the RS-bulk SM effects it is done at leading order. 
Then D RS gets the effects from KK mode through C RS . With the formula of Eq. (p2|), we 
numerically compute C RS as a function of nc- In principle we should diagonalize an infinite 
dimensional matrix M. t to obtain its mass eigenstates and mixing matrix. In reality of 
numerical calculation, however, this is not possible. Instead we take a large finite number 
noo, and truncate the contributions of KK modes at nc(< n^). 
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FIG. 5: C? s clS cl function of n c , with Jzew = 10 TeV and m t o = 200 GeV. The dashed line is for 
n oo = 50, the dashed-dotted line for = 100, and the dotted line for = 200. 

Figure | shows C^ s with the RS-bulk SM effects as a function of ric for kr c = 11.5, v = 
—0.3, Icew = 10 TeV, and m ti o = 200 GeV. The dashed line is for = 50, the dashed- 
dotted line for n^ = 100, and the dotted line for = 200. Numerical diagonalization of 



a large dimensional matrix is performed by a FORTRAN package LAPACK [26]. It is clear 
that the C^ s is well behaved even with extremely many KK modes of W boson and up-type 
quarks. We note that this converging behavior is mainly due to the suppression from the 
W boson KK masses. Without the factor (mw/M^ in Eqs. fl5"2"D , for example, C^ s at 
n = nc = 50 would not converge but keep decreasing with the value of order -0.5. In fact 



the RS-bulk SM effects on the precision electroweak observables [ II| , and on the anomalous 
magnetic moment of the muon PD| have been also shown finite. In what follows we employ 
rioo = 100 and nc = 50. 

In Fig. H we present phenomenological constraints on {k,EWi m t,o) plane for v = —0.4 as 
suggested by the previous Ap constraint. The solid lines come from the observed top quark 
mass of 175 ± 5 GeV. For large Icew of a few TeV, m t fl itself is the physical mass of the 
top quark, while low kEw of the order 100 GeV allows considerably high mo- We notice 
that the observed top quark mass alone can put a significant lower bound on kEw such as 
k,Ew ^ 310 GeV for v = —0.4. Taking a step further, let us investigate the implication of 
the first excited KK mode of top quark, albeit unobserved yet. As an example, we present 
the condition, denoted by the dashed lines, that the first excited KK mode of top quark has 
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The solid lines are from the top mass constraints. The dashed line corresponds to M{ op ~ 1 TeV, 
and the dash-dotted lines from the measurement of b — > s'y at 95%CL. 



mass about 1 TeV, which removes most of the parameter space with low ksw and high mo- 
The current data on Br (B — > X s + 7) |23j are also presented with the doted lines at one 
sigma level, and the dot-dashed lines at two sigma level. It shows that the modified RS-bulk 
SM can also accommodate the h —>■ 37 constraint. At one sigma level, the b — > 57 decay, with 
the constraint from the observed top quark mass, can impose strong lower bound on kEw'- 
k>EW ^ 700 GeV for v = —0.4; these correspond to the M 1 op ~ 1 TeV. This bound is to be 
compared with the constraints from the Drell-Yan and dijet production at the Tevatron Run 
I, with the oblique parameter constraints, which put the lower bound on m^ aviton > 750 



GeV PI. Since Tn^! aviton — 3.83 kEw, this Tevetron bound is rather weak as k^w ^ 196 
GeV. 

Some comments on the D-meson mixing is in order here. Since our assignment of different 
bulk fermion mass for the SU(2)-singlet 6-quark yields different KK mass spectrum of the 
6-quark from those of the strange- and down-quark, we may encounter sizable FCNC in 
the up-quark sector. Further investigation is to be done. However, considering the current 
low accuracy on the D-meson mixing measurement [ 27]] , and the role of W boson KK mass 
spectrum in suppressing and thus stabilizing the new contribution to b — > 37 due to the 
factor (mw/Myy^j , we expect that the new effects on the D-meson mixing is also likely to 
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be acceptable. 



VI. CONCLUSIONS 

We have studied the quark Kaluza-Klein mode mixing in the Randall-Sundrum scenario 
where all the SM fields except for the Higgs field are placed in the bulk. This KK mode 
mixing occurs due to the Yukawa masses of the bulk fermion with the Higgs field confined to 
our brane. We have reviewed in detail the KK reduction of the bulk Dirac fermion field in the 
RS background. In order to obtain non-trivial solution of the bulk wave functions, a Dirac 
fermion with a definite hypercharge should possess both chiral states. That is, there must 
be additional right-handed SU(2)-doublet and left-handed SU(2)-singlet fermions which are 
to be assigned Z2-odd symmetry to avoid their zero modes on our brane. It is explicitly 
shown that the KK mass terms are between the left- and right-handed chiral states of a 
specific representation while Yukawa couplings relate the SU(2)-doublet and SU(2)-singlet. 
For the top quark of non-negligible Yukawa mass, this mismatch between KK mass matrix 
and Yukawa mass matrix generates the mixing among the KK modes of the top quark. 

Immediate problems of this top quark KK mode mixing are their dangerous effect on the 
p parameter and the FCNC. We have shown that in the minimal model with a common 
bulk fermion mass, quite large mass shifts between the top and bottom quark KK modes 
are generated, resulting in disastrous contribution to the p parameter. The minimal model 
is to be extended. We relax the universal bulk fermion mass, and let the SU(2)-singlet 
bottom quark field have a different bulk fermion mass m'^. It is shown that for example if 
m'^/k ~ —0.6 and m^/k ~ —0.4, the degeneracy of the top and bottom quark KK mode is 
good enough to suppress the new contribution to Ap. Moreover, the higher the KK mode 
is, the better the degeneracy becomes; the contribution of higher KK modes becomes less 
important. Explicit calculation of the mass eigenvalues and mixing matrix of top quark 
KK modes shows some generic features. For v > —0.3 the mixing is small such that the 
diagonalization can be made perturbatively; their contribution to the rare decay b — > 57 
vanishes to leading order. For v < —0.4 the mixing is sizable: The diagonalization was 
performed numerically. We have demonstrated that even in this case the new effects on the 
b — > 57 can be computed with high reliability. The current measurement of Br(B — > X s + '~f) 
is well accommodated in the modified RS-bulk model. If the future experiment probes the 
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Br(B — > X s + 7) at the current one sigma level, this rare decay mode, with the observed 
top quark mass, can put indirect and meaningful bounds on k,Ew such as ksw ^ 3 TeV for 
v = -0.4. 
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